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) In  Part  I the  contact  or  military  planning  is  examined  from  the 

' standpoint  of  uncertainty.  There  Is  e special  focus  on  the 
uncertainty  surrounding  the  subject  of  03.  It  Is  argued  that 
military  planning  Is  a fuzzy  process.  Tools  being  developed  In 
the  OJCS  to  cope  with  the  subject  of  tactical  C3  are  Introduced  In 
Part  II . case  histories  of  two  decision  aids  which  deal  directly 
with  uncertainty  are  presented 
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ABOUT  THIS  PAPER: 

As  this  contribution  Is  Intended  for  e workshop  presentation,  it  deals  as  much  with  unsolved 
problems  as  with  solutions,  This  dichotomy  Is  reflected  In  parts  I and  II.  In  part  I considerable 
specs  is  devoted  to  the  context  of  the  assessment  of  military  systems  with  particular  emphasis 
on  command  and  control  (C2).  Together  with  communications,  all  three  are  known  as  C3.  [A 
short  definition  of  C3  is  the  people,  processes  and  equipment  through  which  military  operations 
are  controlled  and  commanded.]  My  purpose  is  to  portary  a sense  of  the  uncertainty  which, 
perforce,  pervades  any  peactlme  military  evaluation.  Included  In  pert  i Is  a discussion  of  the 
special  problems  of  assessing  C2/C3.  Part  I contains  no  answers,  only  the  context  for  en 
Investigation.  For  a workshop  the  latter  may  bees  important  as  the  proposals  for  solutions.  In 
part  II , case  histories  of  two  methodological  solutions  to  the  problem  of  dealing  with  uncertainty 
are  presented.  Selected  vugraph  material  from  Us  verbal  presentation  are  Inlcuded  herein. 

PART  I:  UNCERTAINTY  IN  MILITARY  ASSESSMENT 

BACKGROUND 

Local  Influences 

In  1970  a watershed  article  by  Bellmen  and  Zadeh  appeared  In  thw  .Journal  nf  Mnnagwnmt 
Science  entitled  “Decision  Making  In  a Fuzzy  Environment".  [Bellman  and  Zadeh  1970]  After 
some  very  brief  consldratlons  of  my  situation,  I came  to  the  conclusion  that  I need  look  no 
further  than  my  immediate  surroundings  for  e fuzzy  decision  environment.  It  happenend, 
Incidents,  that  my  position  at  the  time  was  with  the  Office  of  the  Chief  of  Staff  of  tho  Army  In 
the  Pentagon.  Despite  the  Apparent  Incongruity  between  the  popular  conception  of  the  Pentagon 
as  a place  where  only  crisp  decision  making  takes  piece,  it  Is  In  fact  a place  where  people  must 
cope  with  uncertainty  on  a daily  basis.  The  peace  time  decision  maker  In  the  Pentagon  does  not 
deel  with  circumstances  on  a particular  battlefield.  He  deals  rather  with  what  might  happen  on 
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some  battlefield  in  a war  he  hopes  will  never  be  fought.  Understanding  that  the  Pentagon  was, 
and  remains,  a fuzzy  environment  served  not  only  to  Introduce  me  to  fuzzy  set  theory,  but  as 
Importantly,  to  orient  my  perceptions  as  to  the  true  nature  of  the  turroudings. 

Prior  to  reading  the  Bellman  and  Zadeh  article  I probably  adhered  to  the  classical  approach  to 
the  elimination  of  uncertainty.  This  is  the  trio  of  hard  work,  closer  observation,  and  above  all, 
more  data.  When  the  world  about  you  is  fuzzy , then  only  hard  work  remains  from  the  foregoing 
trio.  More  fine  grain  examination  only  exacerbates  the  fuzziness.  In  fact,  theoretical 
arguements  exist  In  the  fuzzy  set  literature  which  gainsay  the  Importance  of  more  data.  In 
fact,  fuzzy  sot  theory  predicts  that  only  reformulation  of  the  problem  can  further  reduce 
fuzzinses  once  some  limit  has  been  reached.  [Aeel  1977] 

As  I examined  my  envlronement  further , I observed  that  it  was  not  only  fuzzy,  but  that  is  also 
was  wont  to  operate  on  subjective  judgements.  This  was  particularly  true  of  "military 
judgement"  for  which  many  unnecessary  and  defensive  apologise  continue  to  be  made,  in  fact 
subjective  judgement  appeared  to  be  a standard  method  of  coping  with  uncertainly,  it  appears  to 
be  a legitimate  way  of  coping  with  a number  of  common  difficulties  In  environments  such  as  the 
Pentagon.  For  example,  all  the  following  create  a climate  of  uncertainty: 

o A firm  requirement  to  predict  whet  seme  to  be  the  free  future  and  plan  accordingly.  j 

o Performing  legitimate  forecasting  In  the  presence  of  subjective,  biased,  or  indeed 
erroneous  Information. 

o Incorporating  political  aspects  of  a problem. 

I 

o Producing  a plan  whose  Inputs  ere  a marriage  of  scientific  certainty  end 

guesstimated  axptrepoletlon  and  missing  information.  . j 
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( l would  hasten  to  add  that  we  do  not  consider  the  term  subjective  synonomous  with  politically 
motivated  action.) 

Coping  with  Ucerteinty  in  Assessment 

The  option  of  no  decision  due  to  uncertainty  Is  not  available.  How  then  to  deal  with  this  climate 
of  extreme  uncertainty?  At  this  juncture  three  divergent  paths  are  open, 

o One  can  try  to  remove  the  subjectivity;  and  otherwise  ameliorate  the  uncertainty  In  the 
inputs.  ( The  result  could  be  called  factoids.  [ Datamation  1 986} ) The  "objectlvlzed"  data 
Is  then  subject  to  a variety  of  tools,  many  of  which  may  be  subjective.  This  is  the  path 
most  often  followed  Common  examples  include  programs  which  ere  besed  on  weighting 
constituent  characteristics,  or  goal  programming. 

o One  con  also  try  to  opersts  precisely  on  the  subjective  Inputs  and  Imprecise  data. 
This  path  Is  less  often  followed  Examples  Include  elaborate  linear  programs 
based  on  Delphi  Input,  and  multi-attribute  utility  theory  approaches, 
o One  can  also  try  to  operate  scientifically,  hut  not  rucesaartly  precisely,  on  subjective 
Inputs.  This  path  seems  least  often  followed  Examples  Include  some  expert  systems, 
fuzzy  sets,  and  evidence  theory. 

In  fuzzy  sets  I found  a suitable  tool  for  exploiting  the  third  path.  A good  portion  of  this  paper 
will  raoount  the  caee  history  of  a major  attempt  to  deal  with  uncertainty  using  fuzzy  sets.  In 
particular,  a computer  code  to  aggregate  (roll-up)  information,  based  on  the  operational  status 
of  units  expressed  as  color  labels,  will  be  treated.  Other  case  histories  will  be  sketched 
Including  one  which  uses  a form  of  Imprecisely  specified  multi-attribute  utility  theory. 

Because  any  approach  token  must  be  directly  ovaileble  to  Pentagon  action  officers  and  analysts, 
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any  solution  to  dealing  with  uncertainty  must  be  directly  available  on  a local  area  computer 
network  and  employ  techniques  which  are  transparent  to  the  usar  and  avoid  the  need  for  precise 
and  highly  granular  data. 


THE  SPECIAL  PROBLEM  OF  EVALUATING  MILL1TARY  C3 
The  Context 

The  triad  of  command  and  control  plus  communications  (and  sometimes  intelligence  and/or 
computers)  presents  a specialized  challenge  to  dealing  with  uncertainty.  C3  represents 
infra-structure.  The  commend  control  portion  (C2)  especially  can  only  really  be  judged  by 
what  Is  causes  other  elements  to  do,  or  by  what  It  prevents  from  happening.  Thus,  estimating 
the  effect  of  future  C3  programs  entails  forecasting  the  uncertain  performance  of  the  weapons 
and  people  controlled,  and  their  employment  against  a projected  (and  therefore  uncertain)  foe. 


Against  this  fabric  of  uncertainty,  the  evaluation  of  C3  must  taka  place.  The  analyst  must  decide 
whether  the  proposed  C2/C3  schemes  with  their  own  degree  of  uncertain  performance,  will  not 
only  guide  the  forces,  but  alao  work  either  to  limit,  or  to  enhance,  the  uncertainty  of  the 
battlefield.  The  estimation  process  therefore  does  not  take  place  in  the  abstract  Thus,  we  can 
understand  the  functioning  of  a communications  network  perfectly,  and  still  he  highly  uncertain 
as  to  the  degree  to  which  it  supports  the  main  objectives;  be  they  keeping  the  peaoe  or  waging  the 
war.  in  this  estimation  process  one  also  confronts  the  problem  of  deciding  both  what  is 
probable,  and  also  what  is  possible. 


To  my  way  of  thinking  both  the  actual  functioning  of  C2  systems  in  which  human  decision  enters, 
and  the  peactime  evaulation  of  such  systems,  are  paradigms  of  approximate  reasoning.  They  ora, 


r 


[ft 

ft 

v 

r 


ft 

ft. 


5 

% 

r 

r 


J.  DOCKERY 

FINAL  VERSION-DEC  29.1986 


USNPQ  UNCERTAINTY  WORKSHOP 
NOY.  13-14,  1986 


as  well,  quintessential^,  fuzzy  processes.  This  paper  will  now  focus  on  the  peacetime 
managerial  process  of  evaluating  C2/C3  systems.  The  difficult  question  of  how  C2/C3  systems 
behave  when  employed  In  an  active  defense  situation  is  subsumed  in  the  prior  evaluation. 

A Distinction 

Before  moving  to  a closer  examination  of  uncertainty  in  the  evaluation  of  C2/C3,  and  the  case 
histories,  the  focus  of  this  paper  needs  to  be  narrowed  atill  further.  The  basis  of  the  narrowing 
Is  a distinction  between  strategic  and  tactical  C2/C3.  Loosely  speaking,  we  may  assume  that: 
o Strategic  systems  involve  the  global  reach  of  the  armed  forces,  and  what  is  more  they 
have  come  to  be  identified  rather  exclusively  with  the  forces  that  deliver  nuclear  weapons, 
o Tactical  systems  Involve  more  localized  combat  against  a variety  of  threat  postulations. 
Whereas  the  strategic  forces  ore  pre-conflgured  fx  a rather  specific  role  against  a 
defined  threat,  the  tactical  fxces  represent  rather  mxe  a collection  of  resources 
which  can  be  rapidly  molded  Into  the  configuration  needed  to  oppose  a generalized  threat 
Figure  1 summxlzee  the  posited  role  of  tactical  C3. 

[FIGURE  1 GOES  HERE] 

Strategic  C3  System  Uncertainties 

Analysis  of  strategic  C3  systems,  which  fxms  the  basis  of  that  input  to  the  evaluation  cycle,  is 
quite  scientific  and  precise  compared  with  analysis  of  tactical  C3  systems.  In  order  to 
understand  this,  one  may  think  of  a spectrum  in  which  we  move  from  manning  the  equipment  to 
equipping  the  men.  The  C3  systems  associated  with  the  fxmx  are  strategic.  They  tend  to  be 
equipment  xlantad,  while  the  latter  ere  associated  with  tactics  end  so  involve  a considerable 
amount  of  real  time  human  decision  making. 
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• SETS  BOUNDARY  CONDITIONS 
FOR  COMBAT 

• A SOURCE  OF  COMBAT 
OBJECTIVES  AND  DfRECTION 

• CHANNEL  FOR  PROVIDING 
RESOURCES  AND  RESUPPLY 

■ ARGUABLY  THE  SOURCE 
OF  THE 

SELF-ORGANIZATION 
PRINCIPLE  FOR  COPING 
WITH  CHAOS  IN  COMBAT 


Figure  1:  Summary  of  Tactical  C3  Roles 
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While  there  is  uncertelnty  in  projecting  the  performence  of  strategic  systems,  one  is  dealino 
chiefly  with  the  probability  that  concatenations  of  systems  will  perform  as  premised.  This 
entails  modelling  equipment  performance,  natural  phenomena,  and  the  consequence  of  certain 
military  decisions,  e.g.  nuclear  detonations.  We  are  pretty  good  at  this  kind  of  analysis. 
Although  theC3  would  function  in  real  time,  the  C2  is  analyzed  in  "virtual  time"  by  exhaustive 
procedures  that  test  all  contingencies.  Then,  if  it  is  ever  needed,  the  C3  process  would  be 
simplified  as  follows. 

World-wide  sensing  systems  would  report  and  be  centrally  evaluated  so  as  to  produce  a 
recommendation  to  the  President  Upon  hie  decision,  the  function  of  the  strategic  C3  systems 
becomes  that  of  guaranteeing  delivery  of  his  decision  to  the  fighting  forces.  Because  of  time 
constraints,  the  forces  then  exercise  one  of  many  options  which  they  have  previously  been 
directed  to  usa  Analysis  thus  reduces  to  only  one  of  the  triad,  namely  communlcotlons 
reliability.  The  reel  uncertainty  lias  In  tha  Intelligence  estimates  on  which  the  strategic 
scenarios  are  basil  Worst  case  scenarios  era  popular.  Sirica  they  generally  cost  too  much,  the 
finally  Identification  of  uncertainty  In  the  strategic  evaluation  case  maps  over  into  the 
uncertainty  of  risk  assessment. 

Tactical  C3  System  Uncertainties 

By  thalr  very  dwign  tactical  C3  systems  era  intended  to  be  generic  resources.  From  these 
resources,  a nmmander's  staff  will  build  a temporary  configuration  to  meet  the  current 
requirement!  Thus,  the  specific  role  any  C3  system  mey  play  in  a combat  scenario  lies 
somewhere  within  a large  envelope  of  possibilities.  Tactical  systems  do  have  specific  functional 
niches:  for  example,  mobile  subscriber  systems,  satellite  HF  terminals,  However,  how 
specific  C3  systems  will  relate  to  other  pieces  of  tactical  gear  can  be  uncertain.  In  choosing 
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these  examples  I have  deliberately  biased  the  problem  toward  evaluation  of  joint  tactical 
operations  Involving  the  land/air  battle.  It  is  a far  less  straigtforward  problem  than  say, 
tactical  shipboard  C3. 

Unlike  strategic  communications,  where  there  Is  a demonstrable  one  to  one  correspondence 
between  outcome  and  system  performance,  no  such  assurance  attaches  to  tactical 
communications  gear.  In  fact,  tactical  C3  analysis  is  often  replaced  by  communications  path 
analysis  in  analogy  to  the  strategic  case.  One  can  progress  from  pure  communications  systems, 
through  nearly  automated  sensor  systems,  and  various  display  and  decision  aiding  C2  systems 
such  as  are  found  aboard  ships,  to  C2  systems  having  a considerable  human  element  At  each  step 
the  uncertainty  In  evaluation  Increases. 

In  place  of  statements  about  the  degree  to  which  outcomes  are  influenced,  one  finds  shibboleths. 
Three  of  the  most  common  are  "timeliness",  "accuracy",  and  "quantity"  of  the  data  transmitted. 
Thousand  of  manages  ore  transmitted  far  a handful  of  combat  outcome*.  In  the  face  of 
uncertainty  the  designer  strives  to  transmit  everything.  While  timely  and  accurate  data  may  be 
uaeful,  quantity  can  be  positively  counter  productive.  Resilience  of  C3  systems  to  the  disruption 
caused  by  electronic  warfare  Is  a better  measure  than  any  of  the  previous  three.  In  a swnse 
Jamming  Introduosa  third  ordr  uncertainty  into  the  analysis.  Restating  the  chain  of 
uncertainty  which  relates  the  evaluation  of  tactical  C3 , we  have  following  worst  case  sequence. 
C2/C3  systems  of  uncertain  performance  influence... 
the  performance  of  combat  in  uncertain  ways... 


against  an  uncertain  foe.. 


J.  DOCKERY 

FINAL  VERSION-DEC  29.1986 


USNPG  UNCERTAINTY  WORKSHOP 
NOV.  13-14,  1986 


The  8aslc  Source  of  Uncertainty  In  C2/C3  Analysis 

The  raw  material  of  the  C2  process  are  future  event  chains.  Their  creation  and  control  Is  the 
objective  of  C2.  Communications  are  an  element  in  the  process.  How  then  to  assess  uncertainty 
in  systems  designed  to  control  (end  sometimes  create)  uncertainty? 

The  simplest  method  is  simply  to  eliminate  uncertainty  by  fiat.  One  assumes  the  uncertainty 
away  either  in  whole  or  In  part.  Thus,  we  decide  that  C2  systems  will  perform  as  indicated; 
that  they  will  influence  combat  as  advertized;  and  that  the  combat  will  take  place  according  to  a 
prescripted  (and  therefore  certain)  scenario.  Only  the  degree  of  success  is  in  doubt;  The 
arguement  goes  bottom  up,  and  follows  the  line  of  the  fable  that; 

"for  want  of  a nail  the  shoe  was  lost* , 

"for  want  of  a shoe  the  horse  was  lost" , 

(Mil 

"...the  kingdom  was  lost" 

The  problem  with  the  foregoing  is  that  the  projection  may  be  irrelevant  The  usual  question  is 
"did  the  message  gat  through" , which  is  success  of  sorts.  However , for  evaluation  purposes,  the 
question  Is  rather  "did  the  message  have  any  bearing  on  the  outcome?" 

At  the  other  extreme  is  the  response  which  concatenates  all  the  worst  case  scenarios  that  the 
mind  of  the  analyst  can  dream  up.  This  leads  invariably  to  huge  and  expensive  investments  in 
C2/C3.  Since  the  worst  case  sequencing  resulted  in  systems  which  may  have  prevented 
something  from  happening,  how  ia  that  outcome  to  be  judged.  Congress  incidently  may  then 
assume  that  since  nothing  did  happen,  that  nothing  would  have  happened!  The  hapless  decision 
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maker  then  cuts  back  his  worst  case  sequencing.  At  that  point  he  enters  the  murky  waters  of 
risk  analysis.  In  (act  evaluation  becomes  nearly  the  same  as  risk  assessment. 

The  case  histories  and  methods  shortly  to  be  reported  choose  a middle  ground.  They  are  based  on 
the  desire  to  make  the  most  of  informed  military  judgement.  That  judgement  Is  to  be  bolstered 
by  techniques  which  directly  address  the  fundamental  uncertainties,  nay  chaos,  of  combat.  The 
appoaoh  Is  two  tiered;  a suite  of  computer  based  methodologies  for  purposes  of  strategic  and 
tactical  C3  system  analysis  in  plausible  scenarios;  and  a suite  of  analysis  programs  for 
assessing  aspects  of  C2  which  use  both  real  and  simulated  date.  Figure  2 summarizes  the  special 
assessment  problems  of  tactical  C2. 

[FIGURE  2 DOES  HERE! 
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a C2  IS  A SECOND  ORDER  EFFECT 
WHICH  COMPOUNDS  UNCERTAINTY 

o C3  HAS  A PARADOXICAL  ROLE 
TO  BOTH 

ELIMINATE  AND  ENHANCE 
UNCERTAINTY  IN  COMBAT 

• C2  HAS  THE  UNCERTAINTY 
OF  ENORMOUS  COMPLEXITY 
AND  COMBINATORICS 

• THERE  IS  NO  THEORY  OF 
COMBAT  OR  C2 

• C3  ASSESSMENT  INCLUDES  THE 
ADDITONAL  BURDEN  OF 
RISK  ASSESSMENT 

9 THE  ESSENCE  OF  C2  IS  CONTROL  OF 
FUTURE  EYENT  CHAINS 


Figure  2:  Some  Special  Assessment  Problems  of  C3 
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Avenues  to  Assessment  of  C3 
It  Is  necessary  first  to  review  the  generalized  options  open  to  the  analyst  and  decision  maker 
faced  with  the  tesk  of  assessment.  They  may  1m  categorized  as  follows: 
o Computer  Simulation  and  Interactive  War  Oemes 
o Field  Tests/Engineering  Tests/Training  Exercises 
o Analytical  Solutions 
o Expert  Judgement 

The  trouble  with  the  first  two  Is  rooted  In  a classic  design  of  experiments  problem.  Because  C2 
changes  outcomes,  considerable  statistics  have  to  be  accumulated  for  any  configuration.  When 
one  adds  the  fact  that  combat  usual'/  destroys  elements  of  the  C3  infrastructure,  the  universe  of 
outcomes  Is  even  larger.  In  theory  one  then  repeats  the  process  for  each  C2/C3  configuration. 
Practically  speaking,  this  Is  usually  Impossible.  Some  nominal  configuration,  for  which  no 
damage  to  C3  Is  permitted.  Is  usually  analyzed. 

For  on  analysis  of  the  Influence  of  maseaega  traffic  we  have  dr/eloped  a tool  called  C3EVAL  in 
which  one  module  models  a system  of  commend  nodes.  (Robinson,  et  all  986]  A separate  module 
models  combat  Both  modules  are  straightforward  In  themselves  but  can  generate  very  complex 
interactions.  The  model  Is  useful  for  first  order  aiseeiment  of  major  changes  in  organizational 
structure.  Coupling  between  combat  outcomes  and  msesege  traffic  can  be  surpisingly  weak 
according  to  this  model.  Rather,  the  overall  effect  of  the  higher  headquarter  seems  to  be  the 
following:  to  set  and  adjust  boundary  conditions  for  combat;  to  supply  resources;  and  to 
occasionally  make  area  resources  available  locally,  eg.  air  strikes. 

Undr  development  within  another  branch  of  0JC5  [06]  Is  another  major  high  level  model  called 
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JAWS  for  Joint  Analytical  War  Gaming  System,  it  has  C2  built  into  it.  It  is  betnQ  written  in  C 
end  will  be  object  oriented  code.  Both  the  foregoing  design  choices  are  greatly  facilitating 
development  of  a simulation  in  which  the  interaction  of  combat,  planning  end  C3  can  be  modelled. 


Turning  to  the  third  option  we  find  that  the  trouble  is  this.  There  Is  no  accepted  theory  of 
combat,  let  alone  C2.  Everything  is  largely  empirical.  Fragmentary  theory  elements  such  as 
Lonchester  Equations  ere  stretched  to  the  limit  in  simulations.  In  another  semi-analytical 
solution  one  finds  that  the  designers  dispense  with  C3  entirely  and  Instead,  collect  thousands  of 
“factors"  about  consumption,  estimated  attrition,  rates  of  advance,  etc,  eta  These  are  then  put 
into  some  kind  of  computer  program  which  does  bookkeeping  on  the  factors  for  a totally 
prescripted  scenario.  Periods  covered  can  run  to  weeks.  Such  an  approach  might  be 
trustworthy  for  trench  warfare,  but  little  else.  It  isyet  another  example  of  worst  case  analysis. 
Communications  theory  does,  however,  permit  analytical  solutions.  Unfortunately,  linking 
communications  survival  to  combat  outcomes  encounters  the  difficulty  in  the  proceeding 
paragraph. 

For  theatre  level  analysis  of  C3  our  approach  has  bean  two  pronged:  first,  develop  missing 
analysis  tools  for  C2;  second,  cope  with  expert  judgement  where  it  seemed  the  only  reliable 
input  Our  challenge  wes  than  the  need  to  use  expert/subjective  judgement  in  an  analytical 
fashion,  and  to  deal  analytically  with  envelopes  of  uncertainty. 

The  rest  of  this  contribution  will  outline  steps  we  hove  taken  to  develop  tools  to  expand  onsylsis 
horizons,  and  to  deal  with  subjective  information.  Everything  which  is  listed  falls  under  the 
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general  umbrella  of  the  'electronic  workbench' , which  is  our  term  for  the  widespread  use  of  a 
local  area  network  of  computer  workstations  by  the  action  officers  and  the  analysts.  We  close 
Pert  I with  a list  of  currently  (winter  1986/07]  active  tactical  C2  analysis  efforts  which  we 
sponsor.  Figure  3 summarizes  the  foregoing  discourse. 

[FIGURE  3 GOES  HERE] 

Analysis  Tools 

o Analysis  of  tactical  C2  connectivity  and  systems  configurations  using  a tool  of 
geographers  and  sociologists  called  tL-analyais.  [Dockery  1 964]  It  is  based  on  an  analysis  of 
slmpllctat  complexes.  It  has  been  shown  to  be  isomorphic  to  graph  theory  but  more  useful  when 
the  problem  lacks  intial  structure.  The  concept  of  a structural  'backcloth'  arises,  over  which 
generic  traffic  flows.  The  backcloth  'permits  and  allows,  but  dose  not  require'  transactions  to 
occur.  (Gould  and  Johnson  1 966] 

O Through  the  stochastic  Integration  nf  Lanchaalw  Equations,  we  are  gaining  on 
appreciation  of  the  uncertainty  masked  by  deterministic  solution!  White  noise  Is  added  to  the 
usual  Lanchester  equations.  Outcomes  show  considerable  variebiltity.  Our  working  hypothesis 
Is  that  C2  acts  to  control  the  noise  of  combat  [Cobb  and  Harrison  1 986] 

O n*w>1nnin«nt  nf  mmmnrm  nf  offMtlvwwM  for  ffl i flMftt  smb/sla.  [Moore 

1986] 

o Exploration  of  the  cgtMtrnpha  t henry  manifolds  as  generators  of  a decision  landscape. 

Th's  work  has  proven  to  be  a very  rich  source  of  results.  [Woodcock  1986]  Efforts  to 

date  have 

- Statistically  fitted  a Cusp  manifold  to  simulated  combat  data; 

- Embedded  C3  and  combat  conceptually  in  a Butterfly  manifold; 

- Found  the  Double  Cusp  manifold  to  be  a source  of  extended  Lanchester  Equations ; 
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a STRAIGHTFORWARD  PARADIGMS 
RECURSIVELY  APPLIED 

• MODERN  MATHEMATICS 
MADE  TRANSPARENT 
VIA  COMPUTER  SCREENS 

a INTRODUCTION  OF  THE 
ELECTRONIC  WORKBENCH 

a STUDY  COMPLEX  INTERACTIONS 
BETWEEN 

SIMPLE  COMPONENTS 


Figure  3:  General  Methodology  Guidelines  for  Dealing 

with  Uncertainty 


J.  DOCKERY 

FINAL  VERSION-DEC  29,1986 


USNPQ  UNCERTAINTY  WORKSHOP 
NOV.  13-14,  1986 


- Explained  C2  In  low  intensity  conflict;  end 

- Discovered  chaos  in  the  coefficients  of  the  time  dependent  Cusp  aquations  when 
time  Is  treated  discretely.  ( Incidents , the  lest  was  an  elternats  abstract  to  this 
meeting.) 

O Exploration  of  cellular  automata  as  a modal  of  C27C3  and  combat  Interactions  This 
work  should  address  the  large  number  of  ordinary  differential  equations  (ODE)  needed  to 
eddreeeortain  combat  modelling  problems.  (This  work  is  just  beginning.) 
o Work  in  using  more  general  non-linear,  time dBOCOdBll PPUBtigm  for  combat  which 
include  diffusion  and  convection  terms,  and  which  also  embed  Lanchaatar  Equations. 
Results  show  for  the  first  time  the  spread  of  formations  on  the  march,  and  attrition  as 
forces  oloae.  Control  of  the  integration  me/  Involve  the  use  of  fuzzy  data.  An  extensive 
partial  differential  aquation  (PDE)  formulation  is  involved.  [Protopopescu  et 
el  1987] 

o The  C3EYAL.flfldftl.nMHM already  alluded  to. 

Figure  4 summarizes  the  foregoing  in  terms  of  the  special  uncertainties  addressed  by  eaph. 

[FIGURE  4 GOES  HERE] 

Daclaton  Aid  Approach 

o ‘^Construction  and  use  of  the  P«rfnrmim«i  AM— mini  fPMl  rall-up 

program. 

o **  Introduction,  use  and  extensions  of  imwraniaah/  StuilM  HniM-Attrihuta  utility 
UMDd(ISMAUT).  [Scherer  1986] 

O Development  of  the  Mfriilar  Command  and  Control  Evaluation  Structure  ( MCES),  which 
la  an  approach  to  C3  architecture  comparison  using  a robust  but  simple  information 
p reassessing  paradigm.  With  the  aid  of  heuristics,  it  steps  the  user  through  successively 
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Q- ANALYSIS  FOR  UNCERTAIN  STRUCTURE 

i STOCHASTIC  L.E.  FOR  RANDOM  EFFECTS 

• PETRI  NETS  FOR  UNCERTAIN  MOES 
AND 

FUZZY  SETS  FOR  OPERATIONS  ON  MOES 


■ CATASTROPHE  THEORY  FOR 
PRODUCING  A LANDSCAPE  CONTAINING 
ALL  THE  UNCERTAINTIES 

• CELLULAR  AUTOMATA  FOR  THE 
UNCERTAINTY  OF  TOO  MANY  DDEs 

• NON-LINEAR  PDEs  FOR  THE 
UNCERTAINTY  OF  MOVEMENT 
IN  TIME  AND  SPACE 

• C3EVAL  MODEL  FOR  THE 
UNCERTAIN  CONNECTION 
BETWEEN  MESSAGES  AND 
COMBAT  OUTCOMES 
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Figure  4:  Summary  or  Analysis  Efforts  Linked  to  the 
Kind  of  Tactical  C3  Uncertainty  Which  They  Address 
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deeper  layers  of  detailed  analysis  for  each  function  in  the  information  processing 
paradigm.  [Sweet  1986] 

o Investigations  into  the  application  of  axoart  systems  software  to  the  problem  of 
introducing  and  tracking  C3  requirements  as  they  pass  through  the  Planning, 
Programming  and  Budgeting  System  (PPBS)  cycle. 

0 Introduction  Of  a suite  of  highly  interactive  multi-gnal/attrihuta  computer  oronrams. 
[Tllman  and  Hwang  1986] 

**Case  Histories  follow. 

Figure  5 summarizes  the  foregoing  in  terms  of  the  special  uncertainties  addressed  by  each. 
[FIGURE  5 GOES  HERE] 

Before  taking  up  the  can  histories,  e word  about  the  fundamental  difference  between  the  first 
two  entries  on  the  proceeding  list  is  In  order.  The  first  of  theee,  the  PAR  roll  up,  adopts  a 
strictly  bottom  up  approach.  The  programming  operatee  such  that  it  'forgets'  the  details  of  the 
constituent  procewi  once  e roll  up  la  complete,  it  remembers  only  key  elements  In  the 
proem  Then  we  call  simply,  'the  drivers'. 

The  second  of  the  two,  which  Is  I8MAUT,  ieetrtrirt  top  down  approach  toe  decision  aid.  its  goal 
is  the  construction  of  dominance  digraphs  from  an  input  matrix  of  altar  natives  and  utility 
attributes.  Its  programming  operates  such  that  It  'remembers'  ait  details  of  the  interaction 
between,  and  within,  all  levels.  At  all  times  the  algorithms  seek  to  trade-off  all  available 
information,  and  all  designated  hierarchial  clusters  of  informatton. 


Distinctions  are  also  observed  in  the  way  the  two  doe)  with  uncertain  data.  The  PAR  program 
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a PERFORMANCE  ASSESSMENT  USING 
FUZZY  SET  LOGIC  EMBEDDED  IN  A 
COMPUTER  PROGRAM  FOR 
UNCERTAINTY  IN  LINGUISTIC  ASSESSMENTS 

a ISMAUT  FOR  UNCERTAINTY 
IN  SPECIFYING  UTILITIES 

a EXPERT  SYSTEMS  FOR 
THE  UNCERTAINTY  IN 
WORKING  BACKWARD 
FROM  GOALS 

a MULTI-GOAL  & -ATTRIBUTE 
PROGRAMS  FOR  UNCERTAINTY 
IN 

CONFLICTING  BOUNDARY  CONDITIONS 
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Figure  5:  Decision  Aiding  Tools  Linked  to  the  Kind  of 
Tactical  C3  Uncertainty  Which  They  Address 


20 


-w 


J.  DOCKERY 

FINAL  VERSION- DEC  29,1986 


USNPQ  UNCERTAINTY  WORKSHOP 
NOV.  13-14,  1986 


ip 


needs  little  In  the  way  of  numerical  dote,  working  Instead  with  linguistic  variables,  For 
ISMAUT , on  the  other  hand,  we  need  numerical  Information  but  only  In  the  minimum  form  of  a 
rank  ordering. 
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PART  II:  CASE  HISTORIES 
PROBLEM  STATEMENT 

The  problem  at  hand  Is  to  present  a portrait  to  the  Joint  Chiefs  on  the  world  wide  status  of  the 
degree  to  which  C3  support  the  global  defense  mission  of  the  US  government.  In  order  that 
improvements  cen  be  directed  where  shortfalls  have  been  uncovered,  some  linkage  to 


programmatic  dollars  must  be  made.  We  should  avoid  a negative  focus  on  the  deflclences  In  the 
capability  of  C3  to  provide  support.  Results  of  the  foregoing  assessment  process  guide  decision 
makers  In  allocating  constrained  budgets  for  C3  Infrastructure. 

THE  PERFORMANCE  ASSESSMENT  (PAR)  ROLL-UP  PROORAM 
The  Specific  Challenge 

Bate  a global  C3  evaluation  scheme  on  Information  about  C3  capabilities  to  support  missions. 
Use  the  information  on  capability  ee  a kind  of  hinge  so  that  we  cen  look  at  capability  statements 
as  pointing  in  two  directions. 

( 1 ) Capabilities  can  be  tied  to  specific  expenditures  for  equipment,  or  changes  In 
personnel  or  organizational  procemea, 

(2)  Estimates  of  the  operational  status  of  a particular  mission  can  be  inferred  from  the 
operational  statue  of  the  requisite  capabilities. 

Automate  the  evaluation  process  to  account  for  Items  ( 1 ) and  ( 2)  above  which,  heretofore,  had 
been  manual. 

We  can  examine  the  second  point  further.  If  we  knew  how  well  C3  supported  the  missions,  for 
which  a theatre  commander  Is  responsible,  and  also  the  degree  to  which  he  depended  upon  them , 
then  we  could  presumably  dnlde  just  how  well  theatre  operations  were  supported  by  C3  assets. 
One  more  level  of  aggregation,  based  on  like  estimates,  would  Infer  global  performance  from 
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theatre  level  performance. 


a 


Details  of  the  PAR  Process 

C3  capabilities  are  phrased  in  terms  of  the  ability  to  do  somethlnQ  usually  associated  with  C3, 
eg.  "look  more  than  30  kms"  or  "proem  more  then  1 00  messages  per  Interval"  or  "react 
within  5 minutes  with  a decision".  Inability  to  meet  such  requirements  are  translated  Into 
equipment  deflclences  or  organizational  difficulties,  e,g  a radar  which  is  not  powerful  enough, 
or  a command  staff  with  the  wrong  mix  of  people.  Two  judgements  can  be  made  about  these 
capabilities. 

o Whet  Is  the  operational  state  of  the  capabilities  in  a given  million  and  theatre  context 
o To  what  degree  does  the  next  hlararchlal  level  depend  on  each  of  the  constituent  elements 


v 


at  the  proceeding  level. 

Usually,  the  aggregation  proem  occurs  within  the  context  of  a theatre  of  operation  until  that 
level  Is  reached.  Moreover,  four  separata  hlsorchies,  depending  on  the  type  of  military  conflict 
anticipated,  are  Involved;  Peace- crisis,  conventional  warfare,  and  two  states  of  nuclear  war. 
Each  war  posture  is  further  evaluated  for  the  currant  budget  year  and  for  the  FYOP  (or  five 


i*; 


year  defense  projection)!  Some  numbers  are  also  instructive. 

o Five  to  seven  capabilities  on  average  are  Involved  for  each  mission 
o Seven  to  ten  missions  on  average  support  the  theatre 


if 


a 


o Thors  are  ten  theatres**  world  wide, 

**Thaatre  Is  used  heroin  es  shorthand  for  the  ten  unified  and  specified  commands  which  cover 
the  world  both  functionally  and  territorially.  Each  has  eCINC( commend- in-chief). 
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The  number  of  combinations,  including  further  sub-structure  not  yet  discussed,  approaches 

100,000. 

We  summarize  os  follows. 
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(Sets of  C3  capabilities oggrogate  to 
Mission  support  capabilities. 

( Sets  of  C3  mission  capabilities)  aggregate  to 
Theatre  support  capabilities. 

( Sets  of  theatre  capabilities)  aggregate  to 
Global  support  capabtttlttes. 

In  figure  6 the  aggregation  process  is  shown  graphically. 

(FIGURE  6 OOES  HERE). 

Actually  the  process  Is  bit  more  complex.  At  both  the  mission  and  theatre  level,  there  Is 
sub-structure  in  the  form  of  sub-levels  which  correspond  to  the  intensity  of  the  conflict 
supported.  These  range  from  four  to  six.  Additionally  the  theatre  aggregation  sub-levels  may 
include  more  than  one  mission  sub- level!  Finally,  the  mission  sub-levels  have  some  horizontal 
sub-structure  as  well.  The  C3  capabilities  support  is  more  narrowly  focused  onto  support  for 
three  (and  sometimes  four)  C3  sub-functions  of  the  missions.  These  are  called  functions  and 
ware  respectively; 

flON/TOff  DECIDE  EXECUTE  (RECONSTITUTE) 

This  introduces  an  intermediate  need  to  'roll-across'  at  the  mission  level  before  aggregating  to 
the  theetre  level.  ( It  elso  provides  the  opportunity  of  metntelning  the  distinction  as  well.) 
Sometimes  Super-Missions,  equivalent  In  level  to  theatre,  are  also  created  by  aggregating 
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Figure  6:  Basic  Four  Level  Hlerarchial  Structure 
(Capabilities  -->Mlssions— >Theatres— >G1obal] 
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combinations  of  missions  over  all  theatres.  See  figure  7 for  a summary, 

[FIGURE  7 GOES  HERE] 

A Fu2zy  Roll-up  Program 

The  search  for  a proper  mathematical  framework  upon  which  to  base  a automated  decision 
support  package  began  with  the  baste  input  That  date  was  judgemental  in  nature  and  expressed 
linguistically.  Operational  readiness  statements  about  the  C3  capabilities  were  often  found  to  be 
expressed  according  to  color  labels.  A GREEN  capability  was  operational  without  qualification.  A 
RED  one  was  out  of  commission.  YELLOW , and  the  various  combinations  of  intermediate  colors, 
were  all  somewhere  in  between.  (Two  additional  limit  colors,  called  SUPER-GREEN  and 
SUPER-RED,  were  also  added.)  Moreover,  the  linkage  between  levels  was  usually  stated  In 
terms  of  some  degree  of  dependency  like  ESSENTIAL,  or  IMPORTANT,  or  NOT  VERY  IMPORTANT. 


A computer  program  was  evolved  which  used  the  linguistic  information  directly  in  the  following 
manner.  From  the  sat  of  color  labels  for  operational  readiness  of  a capability  to  support  a 
mission  function,  a possibility  distribution  wes  constructed.  In  the  display  following  is  an 
example  of  such  a distribution  expressed  as  a percentage. 

CAPABILITY  SB  QR  Y/G  YEL  R/Y  RED  SR 

ABILITY  TO  LOOK  30  KM  30  85  45  — 

SEND  MESSAGE  IN  5 MINUTES  — 75  45  

•For  each  capability,  the  computer  program,  through  a series  of  menu  driven  screens,  solicited 
these  posslbllty  distributions.  Data  was  collected  in  the  field  at  meetings  between  teams  from 
the  OJCS,  C3SE  office  and  local  C3  support  staff  at  each  CINC  Hq.  The  aggregation  program  was 
then  run  by  the  date  collection  teem  to  show  the  local  staff  the  aggregated  results.  CINC  date  wes 
merged  in  Washington. 
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Between  each  level,  (and  within  the  mission  level),  a fuzzy  set  sat  of  dependencies  was  also 
constructed  Although  the  program  works  with  any  set  of  dependencies  and  associated  fuzzy 
membership  functions,  a single  set  of  dependencies  (for  each  level)  was  used  In  the  first  field 
test.  Thus,  the  dependency  of  the  various  sub-functions  of  a mission  on  the  supporting  C3 
capabilities  might  be  expressed  as 

(ESSENTIALI0.85,  VERY  IMPORTANT|0.75,AVERAGE|0.6,MODEST|0.3(NONE|0.1 ). 

For  each  capability  a matrix  is  constructed  whose  rows  are  the  dependency  labels  and  whose 


columns  are  the  color  labels.  Entries  are  the  possibility  distribution  point  values.  Thus,  we 


might  have  the  following.  Note  that  no  special  significance  should  be  attached  to  the  rows  of 


zeros  In  general  the  matrix  may  he  non-zero  anywhere. 


MATRIX  FOR  CAPABILITY  Cl 


SO 

ESSENTIAL 
Y.IMPORTANT  0 

AVERAGE  0 

MODEST 
NONE 


OR  O/Y  YEL  Y/R  RED  3R 

0 

0 0 .30  .85  .45  0 

.90  .80  0 0 0 0 

0 

o 


( In  practice  no  more  than  one  row  was  usually  ever  filled  In.) 
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A set  of  capabilities  was  then  combined  using  the  fuzzy  AND/OR  operation  between  the  matrices 
for  each  capability.  Computationally  this  corresponded  to  selecting  the  maximum  value  for  each 

row-column  entry.  Thus,  where  N «C|  UC2U ...  C^, 
njj  ■MAXtyjitsk'O.N). 

But  N is  only  an  intermediate  matrix  result  since  the  row  labels  are  themselves  a fuzzy  sat. 
Kaufmann  calls  this  a conditioned  fuzzy  matrix.  [Kaufmann  1975].  In  order  to  get  the  final 
result  the  fuzzy  set  corresponding  to  the  row  labels  must  be  combined  with  N.  Formally,  the 

operation  is  represented  for  each  element  In  the  resultant  row  matrix  M^  for  the  mission 
sub-level  is  as  follows,  where  D is  the  row  matrix  of  dependncy  labels, 


%-MAX1tMIN[dij|njkn 


k [color  set] 


One  last  step  remains.  A projection  operator  is  applied  to  li  to  get  the  largest  value  row  entry. 
The  resultant  color  1$  the  label  associeted  with  that  entry.  In  practice,  ties  were  common.  To 
break  ties,  the  screen  prompt  asked  the  user  whether  he  was  a PESSIMIST  or  an  OPTIMIST.  If 
the  former,  the  color  label  closest  to  RED  was  chosen;  and  contrarywlse  for  the  latter.  Figure  8 


summarizes  the  foregoing. 


[FIGURE  8 GOES  HERE] 
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At  this  stags  the  program  has  rolled  up  one  set  of  capabilities  that  support  but  one  conflict 
intensity  sub- level  of  a single  function  of  one  mission  in  a theatre  for  one  war  posture,  and  one 
of  the  two  bugetary  horizons.  The  next  step  is  to  complete  all  three  (four)  mission 
sub-functions  for  all  mission  sub-levels.  In  order  to  achieve  the  roll  across  aggregation,  a 

matrix  is  instructed  for  each  sub-level  usinQ  the  row  matrlcles  Mj  discussed  above.  The 
process  may  be  either  manual , or  automatic.  If  Vie  letter , a word  of  caution  is  in  order.  There 
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Figure  8:  Schematic  Illustration  of  C3 
Capabilities  Rolling  Up  Into 
Mission  Sub-Levels 
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is  a limit  to  the  number  of  fuzzy  operations  which  can  be  concatenated  before  the  result  is 

meaningless.  You  might  say  that  the  orginal  input  data  Is  'used  up'  in  a fuzzy  program.  The 

reason  is  that  after  wa  aggregate  to  a color  we  have  mads  a decision  which  reduces  the  initial 

fuzziness.  Working  with  the  initial  results,  we  opted  to  let  the  process  continue  automatically. 

Although  no  new  color  information  was  Input,  a new  and  explicit  set  of  dependencies  of  the 

mission  on  its  sub-functions  was  always  required  as  input 

The  internal  algorithms  rolling  across  the  functions  are  the  same  as  those  doing  the  intial  roll 
up,  and  are  the  self-same  used  to  roil  up  from  mission  to  theatre  level.  (In  the  latter  case, 
multiple  sub-levels  of  a mission  usually  roll  up  to  a single  theatre  sub- level.)  In  initial  trials 
the  automatic  feature  was  used  with  a new  set  of  theatre-mteaton  dopandwiries.  Further  roll  up 
to  global  level  required  new  Input  as  to  the  possibility  that  the  aggregate  color  was  something 
else;  plus  a still  further  eat  of  theatre-global  (^pendencies  was  nsectet  Significant  new 
Information  also  enters  In  at  the  theatre  level  in  the  form  of  risk  assessment  For  Instance 
coping  with  a support  mission  that  has  dtflcianoaa  in  its  C3  support  wlwn  weighed  ogaint  ell 
other  missions.  Likewise  risk  assessment  is  involved  in  making  global  trade-offs  among  the 
CINCa. 

.Features  of  the  Fuzzy  PAR  Roll-up  Program 

In  its  final  form  the  computer  program  permitted  some  limited  options  end  dialogue.  Although 
only  disjunctions  were  permitted,  a menu  of  disjunctions  taken  from  a paper  by  duBois  and 
Pradi  ware  available.  [duBois  and  Pradi  1984]  These  worked  to  weaken  the  disjunction. 
Further , some  limited  statistics  about  entries  in  the  data  base  were  possible. 


I n terms  of  dialogue  the  user  can  ask  to  have  a color  changed.  The  program  responds  by  asking 
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whetner  he  wishes  to  change  any  of  the  dependencies  or  possibility  distributions.  If  not,  there 

la  no  change.  It  Is  also  possible  to  isolate  which  capabilities  drove  a result  which  is  not  green. 

Moreover , since  eech  capability  which  Is  not  green,  is  linked  in  the  date  base  to  a deficiency  and 

line  Item  program , it  is  possible  to  list  those  deffclences  which  must  be  changed  to  Improve  the 

operational  readiness,  and  hence  the  color. 

The  program  has  also  had  a profound  impact  on  budget  perceptions.  Previous  computerizations, 
end  all  manual  aggregations,  involve  a 'bean  counting'  exercise  for  which  the  amelioration  of  any 
deficiency  always  results  in  Improved  readiness.  With  the  fuzzy  program  it  la  quite  possible  to 
hove  a situation  In  which  the  following  oocurs.  A roll-up  is  green  even  though  601  of  its  input 
is  rad.  Conversely,  a roll-up  Is  red  even  though  60S  of  its  input  is  green.  It  all  depends  on  the 
chain  of  causalty.  This  con  never  happen  with  conventional  linear  approaches.  The  fuzzy 
program  effectively  quantim  the  budgrt  pram  Almost  alt  programs  causing  a resultant 
color  must  be  fixed,  or  the  user  must  manually  intervene,  before  the  readiness  color  changes. 
This  leads  to  a concept  of  line  item  program  portfolios  containing  suites  of  C3  items  requiring 
change  rather  than  Individual  Item  changes. 

Verification  of  the  Results 

The  automated  roll-up  was  compered  with  manual  results  from  current  end  previous  years.  In 
all  but  one  case  it  matched  the  earlier  outcomes  using  the  simplest  of  the  disjunctive  operators. 
Hand  computations  were  done  to  check  the  mechanics  of  the  program.  Results  of  the  aggregation 
have  boon  accepted  by  the  users. 

Management  Implications  of  Using  the  Fuzzy  Par  Program 

There  were  several  interesting  changes  Introduced  into  the  management  of  the  aggregation 

process. 
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o Gaming  of  input  to  reflect  wishes,  as  opposed  to  actual  needs,  was  substantially  reduced 
since  the  automated  program  treated  all  computations  equally, 
o (larging  of  results  from  all  ClNCs  was  easier  since  all  were  directed  to  provide  the  same 
kind  of  input  to  the  same  program, 

o Dependence  on  e local  contractor,  who  had  heretofore  done  both  date  collection  and 
manual  roll-up,  was  reduced  to  data  collection  and  input  The  military  managerial 
decisions  associated  with  the  aggregation  were  again  brought  beck  to  the  0X3. 
o The  computer  program  now  permitad  one  officer  to  manipulate  the  entire  data  base 
affording  a previously  unknown  degree  of  consistency, 
o The  data  base  is  available  in  a form  permitting  further  statistical  investigation, 
o So  called  'what-lf  excursions,  in  which  capabilities  are  enhanced,  is  now  easy  to 
do  where,  heretofore,  the  aggregation  was  aone  shot  process  which  ooutd  not  be  repeated. 


Future  Development  of  the  PAR  Program 

The  program  now  in  BASIC  Is  being  rewritten  In  PASCAL  and  will  be  ttad  to  e Wang  computer 
data  base  using  the  relational  data  bass  language  PACE,  Expert  systam  techniques  will  be  added 
to  make  the  program  more  Interactive  in  determining  how  to  changi  colors.  Moreover , a portion 
of  the  PAR  prooeee  by  which  national  goals  are  eventually  Interpreted  In  terms  of  C3 
capabilities,  which  had  not  been  previously  automated,  will  be  the  subject  of  an  attempt  to  use 
goal  directed  artificial  Intelligence  techniques. 

Summary 

A computer  program,  wnbody'InQ  fuzzy  set  computational  algorithms,  aggregates  subjective 
Input  data  In  linguistic  form  over  four  hiararctilal  levels  to  aid  In  the  production  of  a national 
assessment  of  C3  support 
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Background 

The  somewhat  Biblical  acronym,  standing  for  'Imprecisely  Specified  Multi-Attribute  Utility 
Theory',  represents  another  approach  to  Performance  Assessment.  ISMAUT'  Is  actually 
complementary  to  the  fuzzy  sat  based  mathodologty  Just  described.  It  begins  with  the 
Identification  of  line  Item  programs  that  can  be  used  to  fix  perceived  C3  deficiencies.  The 
problem  at  hand  is  then  the  rank  ordering  of  the  various  programs.  The  challenge  in  using 
ISMAUT  is  to  select  and  quantify  those  utilities  which  will  assess  the  degree  to  which  the 
Individual  line  Item  programs  will  snhaca  the  national  C3  support  pasture. 


ISMAUT  Is  a product  of  a group  at  the  University  of  Virginia  Systems  Science  Department  end 
represents  a generalization  of  on  existing  multi-attribute  paradigms.  As  output,  It  produces 
dominance  digraphs  showing  'bands'  of  eltirnettvse,  all  of  which  dominate  lower  ranking 
alternatives. 


In  the  case  of  ISMAUT  we  began  with  an  existing  tool.  No  development  was  required,  but  some 
tailoring  was  In  order.  In  a sense,  the  contractor  was  tasked  to  give  the  tool  a 'miliary  paint  Job' 
by  which  we  mean  adept  It  for  general  use  In  the  Pentagon  decision  making  environment 
Use  of  ISMAUT 

ISMAUT  Is  a model  suitable  for  a group  decision  making  environment  although  it  can  as  well  be 
used  by  an  Individual.  In  a conversational  mode  the  model  solicits  Information  on  sate  of 
alternatives,  and  aet  of  attributes  which  the  alternatives  shore.  The  Information  is  input  to  a 
matrix  whose  rows  are  the  alternative  programs,  and  whose  columns  are  the  attributes.  Ones 
the  rows  and  columns  are  Identified,  the  following  information  is  required. 
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o Any  pairwise  preferences  among  the  S8t  of  alternative  programs. 


o Any  trads-off  weights  between  the  attributes  where  the  description  of  the  weighting 


may  be  Imprecise  such  as  Al  > A2  or  A3. 


o Utility  scores  for  each  attribute  on  each  alternative  at  the  lowest  level  of  disaggregation 
where  description  of  the  scoring  may  be  imprecise  such  as  Ui  > U2  or  somewhat  less 


Imprecise  such  as  U2-  2*U3. 


A key  feature  of  the  model  is  that  any  of  the  foregoing  Inputs  may  be  modified  interactively  by 


the  user  as  the  decision  process  proceeds. 


Typically  the  user/decision  maker's  primary  input  is  pairwise  comparison  of  alternatives,  and 
also  changes  In  trads-off  weights  for  attributes.  The  choice  end  tntiet  configuration  of  the 
utilities  Is  typically  a staff  function.  The  same  it  true  of  the  trade-off  weights.  Thus,  ISMAUT 
is  a managment  tool  which  providM  a meeting  ground  between  daemon  maker  and  supporting 
staff  and  which  employs  the  strong  points  of  each.  The  input  tableau  Is  summarized  in  figure  9. 


[FIGURE  9 GOES  HERE] 


At  each  iteration  ISMAUT  constructs  and  solves  a large  number  of  liner  programming  equations 


(thousands).  Before  each  iteration  e oonsmenoy  check  ie  made  for  ell  current  input  date  end 


choicee  of  ordering.  Practically  speaking  the  consistency  check  exerctses  a powerful  discipline 
on  the  uar.  Unlike  the  fuzzy  PAR  methodology  which  'forgets',  iSMAUT  quite  clearly 
'remembers'  ell  Input  When  we  attempted  to  apply  ISMAUT  directly  to  the  performance 


assessment  process,  there  was  very  little  dominance  of  any  kind.  All  options  fit  into  the  same 


bend.  Further  attempts  at  specification  ran  afoul  of  the  consistency  check.  Increasing  the 


number  of  attributes  to  upwards  of  30  or  so  did  not  help  either.  The  conclusion  we  reached  was 
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Figure  9:  (Upper)  Input  Matrix  Set  Up  for  ISMAUT 
(Lower)  Participants  Inter-Relationship  Thru  Input  Matrix 
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that  the  basic  Input  to  performance  assessment  was  so  uncertain  as  to  be  consistent  with 

virtually  any  hypothesis  if  one  does  not  prune  Information.  Greater  specificity  only  made  the 

situation  worse,  which  is  something  characteristic  of  fuzzy  decision  processes.  Although  wo 

were  able  to  apply  ISMAUT  to  a number  of  test  cases,  the  intial  PAR  data  proved  too  inconsistent 

to  get  meaningful  results. 

ISMAUT  la  capable  of  creating  multi-level  attribute  hierarchy  by  aggregating  lowest  level 
attributes  into  lumped  attributes  which  themselves  may  be  even  further  aggregated.  Trade-off 
weights  between  the  super  attributes  may  also  be  input  Without  significantly  consistent  results 
we  could  not  apply  the  attribute  aggregation  feature  to  the  problem.  I inconsistency  also  ruled  out 
use  of  the  so  called  Inverse  dmlston  making  feature  which  takas  preferred  alternatives  as  input 
It  than  outputs  the  trade-off  weight*  necessary  to  achieve  that  result 
Future  Work  with  ISMAUT 

From  knowledge  gained  by  reworking  the  date  base  gathered  for  the  fuzzy  approach  to  the  PAR. 
end  from  a knowledge  of  whet  wars  the  drivers  of  the  assessment  process,  we  are  again  working 
with  ISMAUT.  The  challenge  is  now  to  construct  portfolios  of  programs.  Futura  work  by  the 
dsvelcpars  of  ISMAUT  will  permit  input  of  the  <fcgree  to  which  alternatives  satisfy  additional 
criteria  Imposed  on  the  utilities  posed  in  the  form  of  poslttve  and  negative  worth.  Still  more 
advanced  work  is  contemplated  in  the  form  of  functional  specifications  for  Implementation  or 
expert  system  techniques  for  searching  solutions  for  portfolios  of  alternatives  which  satisfy 
stated  goals. 

Summary 

We  have  adopted  a modal  for  complementary  use  with  the  fuzzy  assessment  program  which  must 
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work  within  a smaller  envelope  of  uncertainty  than  the  fuzzy  assessment  to  construct  packages 

of  line  item  programs  which  will  change  C3  operational  readiness  at  hiQh  levels. 
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